CONSTRAINTS, MMSNP AND EXPANDER 
RELATIONAL STRUCTURES 

GABOR KUN 

Abstract. We introduce a concept of expander relations. We 
give a polynomial time construction for expander relational struc- 
tures with large girth and constant degree. Our main tool is a new 
type of product for relational structures, the twisted product. 

We use these tools in the investigation of the complexity class of 
Constraint Satisfaction Problems (CSP), a generalization of (hy- 
per)graph coloring problems and the class MMSNP introduced by 
Feder and Vardi. We prove that every CSP problem is compu- 
tationally equivalent to the restriction of the same CSP problem 
to large girth structures. This implies that the classes CSP and 
MMSNP have the same computational power. 



1. Introduction 

Expander graphs are sparse but highly connected graphs. These 
play an important role in graph theory and computer science since the 
work of Ajtai, Komlos and Szemeredi on parallel sorting pQ. "Op- 
timal expander graphs", Ramanujan graphs were found in 1988 by 
Margulis [25], see also Lubotzky, Phillips and Sarnak [22]. More and 
more efficient and simpler constructions were found in the last decade 
[2. 3 lj . Expander graphs seem to touch many areas: recently Lubotzky. 
Samuels and Vishne introduced a concept of Ramanujan complexes 

[221 [21]. 

On the other hand for hypergraphs (relational structures) no similar 
construction or even definition was known. We introduce a concept 
of expander relations. We say that the r-ary relation R on S is e- 
expander relation if for every S\, . . . ,S r C S the number of relational 
tuples with the ith coordinate in Si differs by less than e\R\ from the 
expected value. We construct ^-expander relations with large girth 
(without short cycles) such that every element has bounded degree (is 
in a bounded number of relational tuples). The existence of such struc- 
tures is clear: this is an easy application of the probabilistic method. 
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In order to give a deterministic polynomial time construction of ex- 
pander relational structures with large girth and bounded degree we 
define twisted product of relational structures, a generalization of the 
so-called zig zag product due to Reingold, Vadhan and Widgerson [31]. 
(Alon, Schwartz and Shapira used a similar product called replace- 
ment product in their expander construction |2J, and the recent fibre 
construction by Nesetfil and Sigger is also very similar [29].) Our ap- 
proach is more algorithmic than the usual expander graph construc- 
tions. The novelty of our methods is to construct a bounded degree 
expander with large girth from a bounded degree expander. 

Theorem 1. (Algorithm) Let t be a finite relational type, k a positive 
integer and e > 0. Then for every n large enough (depending on r,e 
and k) there exists a polynomial time constructible e-expander S of size 
n, type t, maximal degree at most M = M T)£ and girth at least k. 

We apply our tool in the investigation of the complexity class of Con- 
straint Satisfaction Problems (CSP for short) and Monotone Monadic 
Strict NP (MMSNP). The class CSP contains homomorphism prob- 
lems, a generalization of hypergraph coloring problems. This problem 
class was intensively investigated in the last ten years mainly in connec- 
tion with the so-called dichotomy conjecture [9]: Is every CSP problem 
either NP-complete or in P? The question has inspired many research in 

combinatorics HUES OS!, algebra H [m ES [23] and lo g ic [2JI2IIE2]. 

The class MMSNP can be defined in terms of colorings, too. An 
MMSNP language is defined with the existence of a coloring without 
finitely many forbidden colored substructures. A typical language in 
MMSNP is the language of loopless, undirected graphs which are 2- 
colorable without monochromatic triangle. The class MMSNP contains 
the class CSP, but it has much bigger expressive power. Feder and 
Vardi proved somehow surprisingly that in a random sense these classes 
are equivalent, see [PJ. The random part of their reduction is a classical 
use of the probabilistic method: they prove that every CSP language 
can random polynomially reduced to the restriction of the same CSP 
language to large girth structures. We derandomize their proof showing 
that CSP and MMSNP are computationally equivalent. 
Theorem 2. (Algorithm) Let t, k be positive integers and r a finite re- 
lational type. For every structure S of type r there exists a polynomial 
time constructible structure S' with girth > k such that for every struc- 
ture T of size < t the equivalence S G CSP(T) <=> S' G CSP(T) 
holds. 

This theorem also answers a problem posed by Nesetfil, Kostochka 
and Smohkova [14J. 
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Theorem 3. Let r be a finite relational type, L C Rel(r) an MMSNP 
language. Then there is a finite set of relational structures T C Rel(r) 
such that 

(1) L has a polynomial time reduction to CSP{T). 

(2) CSP(T) has a polynomial time reduction to L. 

Note that the equivalence of the complexity classes CSP and MM- 
SNP does not only mean that both of these classes contain an NP- 
complete problem. In particular Theorem [3] shows that if dichotomy 
holds for CSP then it also holds for MMSNP. (The class NP admits 
no dichotomy unless P=NP by Ladner's celebrated result |18j.) This is 
quite surprising since the class MMSNP is quite similar to classes with 
the full computational power of NP, see [9j [16] , on the other hand the 
class CSP is conjectured to have dichotomy. 

The combinatorial essence of the proof is the construction of hyper- 
graphs with large girth and chromatic number pioneered by Lovasz [2T] , 
by Nesetfil and Matousek [27J in the case of graphs, see also the recent 
work by Nesetfil and Siggers [25]. For hypergraphs Nesetfil and Rodl 
gave a short probabilistic construction [2S], see also [5J. In particular 
we give a deterministic polynomial time algorithm for the construction 
of hypergraphs with large girth and chromatic number. 

In Section 2 we give the known definitions. Section 3 contains the 
novelties of this paper: the definition and basic properties of expander 
relational structures and the twisted product. In Section 4 we combine 
these with usual expander graph constructions in order to construct 
expander relational structures with large girth and bounded degree. In 
Section 5 we prove Theorem [2] and 

Our terminology follows the one for relational structures since these 
complexity classes are usually defined in this language. But our theo- 
rems also hold for uniform hypergraphs: these can be viewed as sym- 
metrical relational structures. 

2. Definitions, notations 

We will work with finite relational structures throughout this paper: 
we denote these by boldface letters A, B, C, . . . and their base set by 
A, B,C, . . . , respectively. For an r-ary relational symbol R and rela- 
tional structure A with base set A let R = R(A) C A r denote the 
set of tuples of A which are in relation R. We will not state our the- 
orems for hypergraphs. But we may think of a uniform hypergraph 
as a relational structure with one, symmetrical relation, this is if a 
tuple is in the relation then after any permutation of its coordinates 
the resulted tuple will also be in the relation. Our theorems hold for 
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hypergraphs, too, and so do our proofs (possibly after minor changes). 
Recall, that a homomorphism is a mapping which preserves all rela- 
tions. Just to be explicit, for relational structures A, B of the same 
type r a mapping / : A — > B is a homomorphism A — > B if for every 
r-ary relational symbol R G r and for every tuple (x\, . . . , x r ) G -R(A) 
we have (f(xi),..., f(x r )) G i?(B). A cycle in a relational structure 
A is either a minimal sequence of distinct points and distinct tuples 
x ,r 1 ,xi, . . . ,r t ,x t = x where each tuple belongs to one of the re- 
lations -R(A) and each coordinate of V{ and r^i, or, in the 
degenerated case t = 1 a relational tuple with at least one multiple 
coordinate. The length of the cycle is the integer t in the first case and 
1 in the second case. The girth of a structure A is the shortest length 
of a cycle in A (if it exists; otherwise it is a forest and we define the 
girth to be infinity). The degree of an element x of S is the number of 
relational tuples containing x (with multiplicity). Denote the maximal 
degree in S by A(S). Given a function / : S — > R let |/| = XLes \f( x )\ 
denote its first norm and max(f) its maximum, respectively. 

For the relational structure A let CSP(A) = {B : B is homomorphic 
to A}. Similarly Forb(A) = {B : A is NOT homomorphic to B}. For 
a finite set of relational structures of the same type T set CSP(T) = 
U Ae rCSP(A), and Forb(T) = n AeT Forb(A). The class CSP consists 
of languages of the form CSP(T). We present a definition of the class 
MMSNP in terms of colorings following [16]. Let T be a finite set we 
refer to as colors, r a relational type. Denote by $ the forgetful func- 
tor which corresponds to a T-colored relational structure the uncolored 
one. Let T' a finite set of T-colored relational structures, this is r type 
relational structures such that every element is colored by exactly one 
color from V. The class MMSNP consists of languages of the form 
<$>{Forb{F)). 

Examples: Let |T| = 3 and T' consist of the three monochromatic 
edges: this gives exactly the language of 3-colorable graphs. 

A "typical" language in MMSNP is the language of undirected, sim- 
ple graphs that can be colored with two colors without monochromatic 
triangles: in this case |T| = 2 and T' consists of the two monochromatic 
triangles. 

Note that CSP languages are MMSNP languages where the struc- 
tures in T' contain at most one relational tuple. Let us mention that 
if we use injective or full homomorphisms in the definition of Forb 
instead of usual homomorphisms then we get classes with the full com- 
putational power of NP [IB"] . 
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3. Expander relations and the twisted product 

Definition 4. Consider the finite relational structure A, the relation 
R C A r and the multilinear function defined on r-tuples of real-valued 
functions that assigns to fi, . . . , f r : A — > M the sum 

Yl(xi,...,x r )eR(A) l~L=l fi( x i)- 

We will denote this by R(fi, . . . , f r ). 

Given the subsets Si, . . . , S r C A set R(Si, . . . , S r ) = R(xSi, ■ ■ ■ , Xs r )- 
This is the number of r-tuples (xi, . . . , x r ) G R such that X\ G Si, . . . , x r 

Note that the graph theoretical notation E(S, T) denoting the num- 
ber of edges from S to T is a special case of this. 

Definition 5. The r-ary relation R C S r is called e-expander relation 
if for any subsets Si, . . . , S r C S the inequality 

R(Si,...,S r ) - \R\ n j s )l S,] <e\R\ holds. 

The relational structure S is (e, A)-expander relational structure if all 
at least binary relation of S is an e-expander relation and A(S) < A 
holds for the maximal degree of S. 

Remark 6. An expander graph is an expander relational structure 
with one binary relation. An undirected graph is formally a digraph 
(relational structure with one binary relation) where every undirected 
edge is a pair of directed edges, so the number of edges will be the 
double for the digraph. If G is a simple, undirected, <i-regular graph 
with second eigenvalue A then G is an ^--expander: For any A, B C 
V(G) the inequality \E{A,B) - 2\E\^^\ < 2Xy/\A\B\ < ^2|£| 
holds by the so-called Expander Mixing Lemma, see e.g. [13] ■ If the 
second inequality is actually equality then A = B = V(G) and so the 
first inequality is strict. 

We will also need an equivalent continuous definition. 
Lemma 7. For a finite r-ary relation R C S r the following are equiv- 
alent. 

(1) For any functions fi, ■ ■ ■ , f r '■ S — > [0; oo), where none of the 
functions is constant zero the inequality 

R(f u . . . J r ) - \R\B^M\ < e\R\U r i= i max (fi) holds - 

(2) For any functions fi, . . . , f r : S — > [0; 1], where none of the 
functions is constant zero the inequality 

R{fi,---,fr) - \R\ n f s ]j. fil <e\R\ holds. 

(3) R is an e- expander relation. 
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Proof. The implication (1) — ► (2) is trivial. (3) is the special case of 
(2) when all the functions fa are characteristic functions. To prove 
the implication (3) — > (1) we use a standard trick how to reduce a 
statement to its Boolean version by integration. 

R(fi,---j r )-n:=i\fi\$ = 

rmax(fi) rmax(f r ) ^ yrr j j 

J yi =0 • ■ ■ Jy r =0 2^( ei ,...,e r )€R 1 li=l X{yi<fi(ei)}ayi ■ ■ ■ tyr ~ 



rmax(fi) rmax(f r ) \R\ y-rr ( \ . j 

4=0 • • • Jy r =o sr n<=i [ E se5 X{vi<Ms)} )dyi... dy r 



J'max(fi) pmax(f r ) 
j/i=0 ' ' ' Jy, 



=0 



< 



R({s : Vl < / x (a)}, . . . , {s : j/ r < / r (s)}) - 



lift 11^=1 /<(«)}! 



dj/i . . . rfy r < 



Co (/0 • • • CS (/r) • • • dVr = e\R\ UU rnaxifa). □ 

Definition 8. Let A and B be relational structures of type r. We say 
that C is a twisted product of A and B if the followings hold. 

(1) The base set of C is the product set: C = A x B. 

(2) The projection ttb '■ A x B — » B is a homomorphism C —>■ B. 

(3) For every r-ary relational symbol R of type r, 1 < i < r and 
relational tuple t = (t\, . . . ,t r ) G -R(B) there exist a bijec- 
tion a ti i : A C such that tie ° a t> i = ^ and (x\, . . . ,x r ) G 
i2(A) (a ti i(xi),...,a t , r (x r )) G i2(C). 

If all the bijections in the definition are identical we get the direct 
product of the two structures. Note hat this definition is "usually" not 
symmetrical. 

In the case of simple undirected graphs the last condition means that 
the preimage of every edge in B is isomorphic to the direct product of 
A and an edge. The celebrated zig-zag product [21] is a very special 
case (e.g. A is a complete graph with loops). Twisted product is much 
more free. Two structures may have many twisted products: a bunch 
of bijections A — > A corresponds to every relation in B. However any 
twisted product of two expanders is an expander. 
Lemma 9. Consider an EA-expander A and an SB-expander B of 
type r. If C is the twisted product of A and B then C is an (ea + £b)- 
expander. And A(A)A(B) > A(C) holds for the maximal degrees. 

Proof. Let R be an at least binary relation of type r. We will prove 
that (2) of Lemma [7] holds for R(C). Consider the functions fi, . . . , f r : 
C — > [0; 1]. Let ft : B — > R denote the function ft(6) = ^2 x&r -in,-\ fi{%)- 
Now | ft | = and for every b G B the inequality < ft (6) < \A\ 
holds. So the expander property of R(B) implies that 
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<e B \R(B)\\A\ 



\gi\---\gr\ 

\B\ r 

■ ,b r ) G -R(B) consider the bijections a^i, 



R(B)( 9l ,...,g r )-\R(B) 

Given an r-tuple b — (pi, . 
a^ T determining the twisted product. Clearly 9i 
ctb,i | • We sum up all the error terms using | A\ \B\ 
\R(C)\ and the triangle inequality. 



\fi\ 



(Pi)\ 



\fi° 



|C|,|i2(A)||i2(B) 



R(C)(fi, 
R(C)(fi, 



Jr)-\R(C)\- 



C 



fr) 



R(C)(h,...,f r ) 
\R(A) 



\R(C)\ 

\R(A)\ 
\A\ r 



\9i\ 



< 



\C\r 

R(B)(gi,...,g r ) 



+ 



R(B)( 9l ,...,g r )-\R(C)\ 



m =1 


\9i\ 




C| 


r 



J2 (i2(A)(/iooy, 

6e_R(B) 

|i2(A)| 



, fr ° «b,-, 



l^(A)| 



+ 



i2(B)(^,...,^)-|i2(B) 



m =1 


\9i\ 




B\ 


r 



< 



E 

6ei?(B) 
l^(A)| 
|A| r 



(|^( A )(A ° "6,1, • • • , /r O «*,r) - J T^- 11 \& ° ) + 

I I i=l 



e B \R(B)\\A\ r < e A \R(A)\+e B \R(C)\ = (e A + e B )\R(C)\. 

The statement about the maximal degrees immediately follows from 
the definition of twisted product. □ 

Now we have arrived at the crucial theorem of this paper, that two 
structures with small degrees may have a twisted product with large 
girth if the first structure has large girth. The previous lemma has 
shown that twisted product preserves expansion. The next theorem 
states that a twisted product can have large girth though the second 
structure has not. 

Theorem 10. (Algorithm) Consider the finite relational structures A 
and B of type r. Suppose that the girth of A is > k and |A| 1//A: > 
A(A)A(B). Then there exists a twisted product C of A and B with 
girth > k. The structure C can be constructed in polynomial time (in 
|A| and \B\). 

Proof. We will define better and better twisted products of A and B. 
In every step the number of cycles of minimal length will decrease. We 
start with the direct product C = A x B. Let Q denote the twisted 
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product after Step i. of the algorithm. The bijections determining Cj 
are denoted by a % v l : A — > C (where v is an r-ary relational tuple of B, 
1 < I < r and -kb ° cx v ,i — v i)- Now we describe Step (i+1). 

Assume that the girth of Cj is j < k. Let t G -R(B) be an r-ary 
relational tuple, 1 < I < r and c, d G Cj such that their distance is 
> k and txb(c) = 7Tb(c') = We will specify other conditions on the 
choice of t, I, c and d later. 

Now we will change the bijection a\ l but none of the other bijections 
defining Cj. The relations of Q+i and C, will agree except of the I th 
coordinate of the tuples in 7r i? 1 (t). 

Set a 1 ^ 1 = (aa 1 ) o a\ h where (aa 1 ) is the transposition of A flipping 
a and a'. 

The figure illustrates this idea on the product of two undirected paths. 
(However our proof deals with undirected edges as a pair of directed 
edges unlike in the Figure.) The number of cycles of length four de- 
creases from two to one in this situation. 




We prove that the number of cycles of length < j is strictly less in 
Cj+i than in Cj. We correspond to short cycles in C i+1 short cycles in 
Cj. Let £ denote the following bijection between the set of relational 
tuples of Cj+i and Cj. For a relational tuple u of Cj+i set £(tt) = u if 
ttb{u) 7^ t, else £(u)h = Uh if h ^ I and = (aa') o u\. 

We will show that the image of a short cycle by £ will be short. Call 
the tuple u critical if £(tt) 7^ u. This means 7Tb{u) = 7Tb(£) and the I th 
coordinate of u is c or d . The I th coordinate is called critical coordinate. 
We call a pair of tuples 1*1,1*2 in C a cutting pair if itb(ui) 7^ ^(1/2) 
and the tuples intersect. Every cycle with length < k has a cutting 
pair else its image by tia would also be a cycle. 
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Claim: Let t±, . . . , t m be a cycle in Cj+i, suppose m < max{k, 2j — 
1}. Then there is no cutting pair such that the common element is c 
or d and this is a critical coordinate of one tuple. 

Note that the Claim implies that . . . ,£(t m ) is also a cycle. Now 
we prove the Claim. We may assume that t\ is critical, t m is not critical 
and the critical coordinate c is a common coordinate. 

If £(tj) = ti holds for 1 < i < m then the sequence of tuples 
£(ti),£(t 2 ) = t 2 , ■ ■ ■ ,£,(t m ) connects c and d in C i+ i, hence m < k. 
Else there is another tuple th with critical coordinate {th)i = d . If d 
is not in the intersection of th and t^-i or t h and t h+ i, or it is in the 
intersection but it is a critical coordinate of both tuples then the above 
sequence of tuples still connects c and d in Cj+i, hence m < k. 

Thus we may assume that d is a critical coordinate of th but not 
of th-i (or th+i), and (by the minimality property of cycles) no other 
tuple contains c or d but ti,t m ,th and th-i (or th+i). If the tuple 
containing d is t h -i then the sequence . . . , £(th-i) connects c 

and d. This yields m < k. If the tuple th-i contains d then both 
C(ti),t 2 , . . • , t h -2, €(th-i) and t h ,...,t m are cycles in C i+1 . (In the case 
h— 1 = 1 or ft = m we get a degenerated cycle with one tuple.) Hence 
j > max{h — l,m — h + 1} and this implies m < 2j. This completes 
the proof of the Claim. 

So the main step of the algorithm does not increase the girth and 
in every step either the girth is smaller or the number of cycles of 
(minimal) length j decreases instead. The image of a cycle with length 
< max{k, 2j} will not be a cycle if it has a cutting pair such that 
exactly one of the two tuples is critical and the critical coordinate is in 
the intersection. The image of other cycles with length < max{k, 2j} 
is still a cycle, and its cutting pairs are the same. 

Let us do the main step of the algorithm for all possible triple c e 
C,l,t (and arbitrary d) such that 7Tb{c) = t\. This doubles the girth 
at least (or increases to at least k). If we do this log(k) times we will 
get the required girth. 

The number of such triples is 0(|B||A|). The running time of a sin- 
gle step is the time to find d: this needs 0(\ A| |B|) using Breadth First 
Search. We can exchange c and d in the appropriate tuples in the same 
time. So the total running time of the algorithm is 0( | A| | A| \B\ 2 log(k)) . 

□ 
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4. Construction of expanders with large girth 

We have introduced our new tools. In this section we combine these 
with known algorithms to give a polynomial time construction of ex- 
pander structures with large girth and bounded degree. First we give 
a randomized polynomial time construction for large girth expanders. 
The goal of this section is to derandomize this. Somehow surprisingly 
we will still need the fact that such expanders exist (but not the ran- 
domized algorithm itself). The proof is a typical use of the probabilistic 
method in the spirit of [7J [9] . 

Lemma 11. Let r be a finite relational type, k a positive integer and 
e > 0. Then there is a A > such that for every n large enough there 
exists a (A, e)- expander of type r on n vertices with girth > k and 
maximal degree at most A. 

Proof. We consider a probability space on the set of relational struc- 
tures with base set {1, ... , 2n}. For every r-ary relational symbol R G r 
and tuple u let Pr{u e R) — independently, where the constant 
D will be chosen later. The expected number of cycles with length < k 
is 0(c h D k ), where c is a constant depending only on r. The expected 
degree of a vertex is 0(D). (A constant depending on r is hidden in 
0(*).) Let A be ten times the expected value of the degree of a vertex. 

The Markov inequality implies that the number of elements covered 
by the cycles with length < k is at most n/2 with probability 1 — o(l). 
The number of elements with degree at least A is also at most n/2 with 
probability > |. Remove these elements with large degree or covered 
by a short cycle. (To get a structure on exactly n elements we may 
remove more.) We state that the resulted structure A will satisfy to 
the conditions of the lemma with probability o(l). 

The girth of A is > k and the maximal degree of A is bounded with 
probability | — o(l). We only have to prove the expander property. 
Consider the r-ary relation R and the subsets Si, . . . S r C {1, . . . , 2n}. 

The probability that \R(S U . . . , S r ) - Dn 11 ^ 15,1 < §£>n is at most 

2e~36 e2Dn by the Chernoff bound. Since the number of the possible 
choices is 2 2nr this will hold for a D large enough with probability > yjj 
for all relational symbol R 6 r and all choice of the sets S±, . . . , S r . In 
particular ||i?(A)| — Dn\ < ^Dn. Hence A is an e-expander. Alto- 
gether the probability that A satisfies the conditions is ^ — o(l), and 
so positive if n is large enough. □ 
Lemma 12. Consider the d-regular undirected graph G = (V, E) with 
second eigenvalue A and the integer k > 2. Let S be the relational 
structure with base set V and a single k-ary relation R k : 
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Rk = {(ai, • • • , a k ) : Vz (a*, a i+ x) G E}. 

Then the relational structure S is a (k — 1)-^- expander. 



Proof. Note that 



2^ I El. Set e 



First suppose k 



2. We will use the expander mixing lemma: for every T,W C V 
the inequality \E(T,W) - d l -^^\ < Xy/\T\\W\ holds. This implies 

R 2 (T,W)\ 



\T\\W\ 
\V\ 2 



R2 



< s\R2\. Hence R2 is an e-expander relation. 

Assume that we have proved the lemma for k — 1. Consider the 
functions x\, . . . , x k '■ S — > [0; 1]. By Lemma [7| we need to show that 

nti 



. %k) — \Rk 



<e{k-l)\R k 



R k (xi, 

For i = 1, . . . , k define the sequence of functions jji : S — > ffi. recur- 
sively. Let y be the constant ^ function and yi + %(a) = Xi(b). 

(a,b)£E 

R2(yi,Xi + i). Clearly < max(yi) < d l ~ l and 



Note that \yi+i\ 

R% ip^l j • • • j "Ei) 



Ui\. Now we use the inductional hypothesis. 



\Rk(xi, 



,x k ) - \R k 



\v\ k 



FT \x 

R 2 (y k -i,x k ) - \R k \ ^0A 



R 2 (y k -i,x k ) - \R 2 



+ 



\Ri 



d\xi 



\Vk-\\ 



VuZl \xi 



V\ 2 
Rk-l 



e\R 2 \max{y k - 1 ) + 

e\R k \ + ^(k - 2) £ |i? fe -i| < (k - l)e|i2 fc |. 
The structure S is really a (/c — l)e-expander. 



< 



< 



< 



□ 



Now we give an algorithm to construct large girth expanders with 
bounded degree. 

Proof, (of Theorem [1]) Let r be a positive integer and every relational 
symbol in R at most r-ary. We know that for some d there exists a 
polynomial time construction of (i-regular expander graphs with eigen- 
value gap |^| < j-. Here we use the construction of Ramanujan graphs 
in [25l [22]. (We can refer to any expander constructions instead: a 
constant power of any expander graph sequence will have the required 
eigenvalue gap, where by the fcth power we mean the graph with the 
same vertex set whose edges correspond to paths of length k.) 

On the other hand by Lemma [Til there exists an |-expander A with 

girth at least k such that \A\* > 2<i r _1 A(A) holds. If n is large enough 
then there exists such an A of size log{n) by Theorem [TT1 and we can 
find it in polynomial time. 

We construct an expander graph G of size r|r with the above proper- 
ties. Lemma fT2l shows how to construct an e^^-expander B on the ver- 
tex set of G with maximal degree 2d r ~ 1 . The conditions of Lemma [TOl 
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hold for A and B, hence there exists a polynomial time constructible 
twisted product C of A and B with girth at least k. Now C is an e- 
expander by Lemma [9] with maximal degree at most M = 2d r ~ 1 A(A) 
and girth at least k. □ 

Note that this algorithm gives loglog(n) girth. One can use this algo- 
rithm to construct an expander with large girth as a twisted product of 
a large girth expander and an arbitrary expander graph. The expander 
with large girth can be small, so the twisted product can preserve many 
properties of the second graph. 



5. CSP vs MMSNP 

Now we prove Theorem [3] showing that CSP and MMSNP are com- 
putationally equivalent. Feder and Vardi have proved the following. 
Theorem 13. [5] Let L be an MMSNP language. Then there is a 
finite set of relational structures T and a positive integer k such that 

(1) L has a polynomial time reduction to CSP(T). 

(2) CSP(T) restricted to structures with girth at least k has a poly- 
nomial time reduction to L. 

The proof was later "streamlined" based on the use of finite duali- 
ties [12], the connection of CSP and MMSNP is investigated also from 
the descriptive point of view here. Feder and Vardi have shown that 
CSP(T) can be reduced to to the restriction of CSP{T) to structures 
with girth at least A; by a random polynomial time algorithm. In or- 
der to prove that the classes CSP and MMSNP are computationally 
equivalent we give a deterministic polynomial time reduction. 

Let T a finite set of relational structures of type r. Set t = max^^j \T\ 
Theorem [2] shows that CSP(T) can be reduced to the restriction of 
CSP{T) to structures with girth at least k. This and Theorem [T3] 
imply Theorem [3J So we succeed to prove Theorem [2J 
Lemma 14. Consider the structures A, B and T of type r, where A 
is an e-expander. Suppose that every relational symbol in r is at most 
r-ary and e\T\ r < 1. Let C be a twisted product of A and B. Then B 
is homomorphic to T iff C is homomorphic to T. 

Proof. By the definition of twisted product there is a homomorphism 
itb '■ C — > B. If B is homomorphic to T then so is C. In order to 
prove the other direction assume that there exists a homomorphism 
ip : C — > T. Let us define the mapping £ : B — > T in the following way. 
For an element b G B let £(6) be one of the elements of T such that 
Kz? 1 ^) ^ V 9 " 1 ^^))! — W\- W e will show that £ is a homomorphism. 
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Let R be an r-ary relational symbol in r, b = (pi, ... , b r ) G i?(B). We 
need to show that (£(&i), . . .,|(6 r )) G i?(T). 

Set = <^~ 1 (£(6j)) fl ^(ftj). We succeed to show that there is a 
tuple (ci,...,c r ) G R(C) with q G S^. If this held then the tuple 
(£(bi), . . . ,£(b r )) = (<p(ci), . . . , (f(c r )) would be in -R(T) since if is a 
homomorphism. 

Denote the bijections corresponding to b determining the twisted 
product C by : A — > -n B l {bi). The tuple (ci, . . . ,c r ) (where c, G 
7Tb 1 for every i) is in i?(C) iff (ck^(ci), . . . , a^(c r )) G i?(A). 

We use the expander property of A for the sets a^j(Si) for 1 < i < r. 
Since i?(C)(S'i, . . . , Si) = R(A)(a^l(S 1 ), . . . , a^l(S r )) we have 

\R(C)(S U . . . , S t ) - |i?(A)|nkP| < £ \ R{A )l 

On the other hand \R(A)\ n j^\ Sl1 > e\R(A)\ by the choice of the 
sets Si and e. Hence R(C)(Si, . . . , S r ) > 0, there exists an appropriate 
tuple (ci, . . . , c r ) G R(C). This completes the proof. □ 

Proof, (of Theorem [2]) Let us choose r such that every relational symbol 
in r at most r-ary. Consider an ^-expander A with girth > k and 

bounded degree. Hence if \A\ is large enough then \A\* > A(A)A(S). 
Such an expander A can be constructed in polynomial time (of |S|) 
for fixed t and k. Now we can use Lemma [10] for A = A and B = S 
to construct a twisted product C of girth at least k. Set S' = C. 
Lemma [TH implies the theorem. □ 
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